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A search for narrow resonances that decay into tt pairs has been performed using 
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Narrow resonances decaying to tt pairs are pre- 
dicted by several theories beyond the standard 
model [1,2]. For instance, one of the scenarios of 
the topcolor-assisted technicolor model in Ref. [2] 
predicts a heavy Z' boson that couples preferen- 
tially to the third quark generation, and not to 
leptons (leptophobic). The cross section for the Z' 
boson in this model is large enough for it to be 
observed over a wide range of masses and widths 
in data available from the 1.8 TeV pp Tevatron 
Collider at the Fermi National Accelerator Labo- 
ratory. 

In searches for such heavy particles or reso- 
nances, we seek an excess of events beyond that 
predicted by the standard model in the distri- 
bution of the invariant mass of tt decay prod- 
ucts. Previous searches at the Tevatron have lim- 
ited a leptophobic Z' boson to a mass higher 
than 480 GeV/c 2 [3]. In this paper, we de- 
scribe a direct search for narrow tt resonances in 
the inclusive decay modes tt — > Iv + > 4 jets, 
where I — an electron (e) or a muon (/x), us- 
ing 130 pb _1 of data recorded by the D0 experi- 
ment from 1992 to 1996. Having observed no sig- 
nificant deviation from the standard model, we 
present model-independent 95% confidence-level 
(C.L.) upper limits on the product of the cross sec- 
tion (ax) and branching fraction (B) to tt, for a 
narrow resonance. We also present a lower limit 
on the resonance mass (Mx) of the Z' boson in a 
particular model [2]. 

The D0 detector is a multi-purpose particle de- 
tector designed to study pp collisions at the Fer- 
milab Tevatron Collider. The detector consists 
of three major systems: a non-magnetic central 
tracking system, a uranium/liquid- argon calorime- 
ter, and a muon spectrometer. A detailed descrip- 
tion of the D0 detector can be found in Ref. [4]. 

The present search rests upon techniques de- 
veloped for the measurement of the mass of the 
top quark at D0 in the lepton + jets channel [5]. 
Due to the large mass of the top quark (m t ), the 
tt — > Iv + > 4 jets final state is characterized by 
a high-pT isolated lepton (e or /x) and large miss- 
ing transverse energy ($ T ) from the undetected 
neutrino. Additional soft muons (xx tags) from 
semileptonic decays of b and c quarks occur in 
w 20% of tt events but only in w 2% of non-tt 
events [6], and therefore offer discrimination be- 
tween signal and background. We consider two 
orthogonal classes of events for this analysis: a) a 
purely topological selection of lepton+jets events 
denoted as e + jets and xx + jets, where the jets 



do not contain a muon, and b) a selection based 
primarily on the presence of a muon contained 
within a jet (/x tag), and additional selections on 
the topology of the event. These events are de- 
noted as e + jets I p and /x + jets/ /x. Details of 
the trigger requirements, reconstruction of events, 
and identification of the e, /x, $ T , and jets can be 
found in Ref. [5]. The principal sources of back- 
ground correspond to standard-model tt produc- 
tion, W(-^> Iv) + jets production, and production 
of multijets (Nj « 5), in which one of the jets 
is misidentified as a lepton and $ T stems from 
jet-energy mismeasurement. For the measurement 
of the top-quark mass, most selections were op- 
timized to reduce the contribution from non-tt 
sources. We therefore use similar selections in the 
present analysis, and these are summarized in Ta- 
ble I. 

The resonance signal X — > tt is modeled us- 
ing the PYTHIA-6.1 [7] Monte Carlo event gener- 
ator, with m t = 175 GeV/c 2 , and CTEQ3M [8] 
parton distribution functions. Initial and final- 
state radiation (ISR/FSR) is included. About 
10,000 events at nine resonance masses between 
400 and 1000 GeV/c 2 are generated, using a width 
Tx = 0.012Mx- This width is significantly smaller 
than the w O.OAMx mass resolution of the D0 de- 
tector for tt systems [9]. Hence, our results are 
dominated by the detector resolution and indepen- 
dent of Tx- The generated events are processed 
through the D0GEANT detector simulation pack- 
age [10] and reconstructed using the D0 event- 
reconstruction program. A standard set of cor- 
rections is applied to electromagnetic objects and 
jets [5], and the missing transverse energy recalcu- 
lated. 

The backgrounds are estimated from a com- 
bination of Monte Carlo simulations and collider 
data [5] . The selections summarized in Table I are 
also applied to the Monte Carlo (MC) signal and 
background samples. 

Each event in data, as well as in the Monte Carlo 
signal and background samples, is fitted to a three- 
constraint (3C) hypothesis for the tt production 
and decay: 

ti^W + bW~b, (1) 
W + -» l + n (or qq'), 
W~ — ► qq' (or l~V\). 

The inputs to the fit are the measured kinematic 
parameters of the lepton and the jets, and the miss- 
ing transverse energy vector, $ T . We minimize 



TABLE I. Summary of event selections. Here $ T ca is the missing transverse energy measured just in the 
calorimeter, r] W is the pseudorapidity of the W boson that decays leptonically, and A4>($ T ,(i) is the difference 
in the azimuthal angle between Tp T and the highest-pr muon. 





e+jets 


fi+jets 


e+jets/fi 


fi+jets/fj, 


Lepton (I) 


E l T >20 GeV 


p l T >20 GeV/c 


E l T >20 GeV 


p l T >20 GeV/c 




M <2 


\ V \ <1.7 


M <2 


W <l-7 




$ T >20 GeV 


$ T >20 GeV 


# T >20 GeV 


# T >20 GeV 




$ T cal >25 GeV 


$ T cal >20 GeV 




# T cai >20 GeV 


Jets 


> 4 jets 


> 4 jets 


> 4 jets 


> 4 jets 




E T >15 GeV 


E T >15 GeV 


£t >15 GeV 


St >15 GeV 




M <2 


|r,| <2 


|r,| <2 


M <2 


fi tag 


No 


No 


Yes 


Yes 


Other 


\$ T \ + \E l T \ > 60 GeV 


l#rl + IptI > 60 GeV 


# T >35 GeV, 


A0(# T ,p) < 170° 




\V W \ <2 


1^1 <2 


if A<t>($ T ,fi) < 25° 


|A<K# T , M )-90°|/90° 










< # T /(45 GeV) 


Events passing 










above criteria 


42 


41 


4 


3 


With x 2 < 10 


16 


21 


1 


3 



X 2 = (x - x m ) T G(x - x m ), where x m (x) is the 
vector for measured (fitted) variables, and G -1 is 
its error matrix [5]. The two reconstructed W bo- 
son masses are constrained to the pole mass M\y 
of the W boson, and the reconstructed t and i 
quark masses are set to m t = 173.3 GeV/c 2 [5]. 
Only the four highest-i>r jets are used in the kine- 
matic fit. All other jets are assumed to be due to 
initial-state radiation, and are ignored. There are 
6 (12) possible assignments of these jets to quarks 
in the events with (without) a fi tag, each having 
two solutions for the longitudinal momentum of 
the neutrino (p"). For every possible permutation, 
we apply additional parton-level and 77-dcpcndcnt 
jet corrections derived using data and Monte Carlo 
simulations [5]. We apply a loose selection on the 
reconstructed mass, M(qq), of the hadronically de- 
caying W boson, 40 < M(qq) < 140 GeV/c 2 , be- 
fore the fit, to reduce computation. The results of 
the fit with the lowest \ 2 are used to reconstruct 
the invariant mass (M t f) of the tt system. It is ob- 
served that the jet permutation with the lowest x 2 
is the correct choice for w 20% of all Monte Carlo 
tt events [5]. We require x 2 < 10 to further reduce 
non-ti background, whereupon 41 events are left 
in the data sample, of which four are ^i-tagged. 

For each Mx sample generated by Monte Carlo, 
we perform a fit based on Bayesian statistics [11] 
to determine the number of events expected from 
signal and background in the observed lepton+jets 



data sample. We fit [9] the data to a three- 
source model comprised of signal (X — > tt), and 
backgrounds from standard-model tt production, 
T^+jets, and multijets. We combine backgrounds 
from W + jets and multijets in the ratio 0.78:0.22, 
based on a measurement of their relative propor- 
tions in the top-quark mass analysis at D0 [5] . We 
define a likelihood (L) and a posterior probabil- 
ity P(ni,ri2,n 3 , Mx\D) for obtaining m, n 2 and 
n 3 events from the three respective sources, for a 
model specified by Mx- Given the observed data 
set D, we can write: 

L(D\n\,n2,nz,M x )w(ni,n2,nz\M x ) 



P(ni,n2,n 3 ,M x \D)= 



A/ 7 



(2) 

where w denotes the joint prior probability for the 
three source strengths, and N 1 is a normalization 
that is obtained from the requirement: 



/ 



P(ni,n2,n 3 ,M x \D)dnidn 2 dn 3 = 1. (3) 



We assume Poisson statistics for the likelihood, 
and flat priors for each of the three sources. 
Bayesian integration [11] over possible signal and 
background populations in each bin i of the M t i 
distribution yields the likelihood: 



L(D\n u n 2 ,n 3 ,M x ) = l[ f] \\ ( 

i=l fel,fc2,fe3=0i = l 



(4) 



where Di (Aji) is the number of events in bin i 
for data (Monte Carlo source j); the indices kj 
satisfy the multinomial constraint kj = ^*! 

Pj = nj/(M + J2iL\Aji) is an estimate of 
the strength of the j th source (j — 1, 2, 3); and M 
is the number of bins. The expected number of 
counts from any source j can be obtained from the 
fit as: 

< rij >= JJJ n jP( n ii n 2,n 3 , Mx\D)dnidri2dn 3 . 

(5) 

The fitted number of events expected from the 
signal (< m >) and the two background sources 
(< n 2 > and < n 3 >) are listed in Table II for 
several values of Mx- The observed M t j distri- 
bution and the corresponding distributions from 
the three Monte Carlo sources normalized to 

< ni >, < ri2 > and < ri3 >, respectively, for 
Mx = 400 GcV/c 2 , are shown in Fig. 1. There is 
no significant deviation from the standard-model 
prediction. Similar agreement is observed for other 
choices of resonance mass. 



14- 

12- 



^10- 
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M(tt) (GeV/c 2 ) 



FIG. 1. Distributions of M t j obtained from the fit, for 
the sum of signal (X — > it) and all standard-model back- 
grounds (open histogram), sum of all standard- model back- 
grounds (hatched histogram), and W+jets and multijets 
(solid histogram), for Mx = 400 GeV/c 2 . The data corre- 
spond to the dots with their statistical errors. 



TABLE II. The fitted number of events expected 
from signal, < m >, and background from standard 
model ti production, < ri2 >, and W + jets and mul- 
tijets, < n,3 >, for different Mx- After all selections, 
41 events are observed in the M t j distribution of lep- 
ton+jets data. 



M x 
(GeV/c 



400 
500 
600 
750 



< m > < n.2 > 



< n-3 > Background 
< ri2 >+< n 3 > 



9.0±7.0 20.5±10.8 13.9±10.2 34.4±14.9 

4.9±4.2 22.2±11.5 15.3±10.5 37.5±15.6 

4.2±3.2 23.7±11.6 15.4±10.6 39.0±15.7 

1.6±1.6 26.8±11.7 12.6±9.9 39.4±15.3 



are subject to several sources of systematic un- 
certainty. The uncertainty due to the jet energy 
scale is estimated by re-scaling the jet energies by 
±(2.5% + 0.5 GeV) [5] before applying any selec- 
tions to the signal Monte-Carlo events. For the 
contribution from ISR/FSR, we compare the ac- 
ceptance for the signal with and without ISR/FSR 
(in pythia). For the uncertainty from the choice 
of parton distribution functions, we compare the 
signal acceptance for the two parton distribution 
sets CTEQ3M and GRV94L [12]. We also con- 
sider the uncertainties in trigger efficiency, lep- 
ton identification, and integrated luminosity. All 
the sources of statistical and systematic uncer- 
tainty in the product AC are listed in Table III 
for M x = 400 GeV/c 2 [9]. 



In the absence of a signal, we proceed to set 
upper limits on the product of the production cross 
section of X and branching fraction to ti, axB, 
by expressing ri\ — ACaxB in Eq. (2), where A 
is the acceptance for X — > it events and C is the 
integrated luminosity. Integrating over n 2 and n 3 , 
we define for every Mx the upper limit on axB at 
the 95% confidence level as: 

/ P(a x B,M x \D)d(a x B) =0.95. (6) 

Jo 



TABLE III. The fractional uncertainty in the prod- 



uct AC from different sources, for M x = 400 GeV/c 2 . 



MC statistics 3.3 % 

Trigger efficiency 3.6 % 

e/ fj, identification 3.8 % 

Luminosity 4.3 % 

Jet energy scale 7.4 % 

ISR/FSR 16.0 % 

PDF 15.0 % 

Total 24.3 % 



The expected shapes of distributions for back- 
ground and signal, and the acceptance for signal, 



For each Mx, we convolute the posterior prob- 
ability density P(ax B, Mx \D) with a Gaussian 
prior for AC, with the estimated value of AC as 
the mean of the Gaussian and its uncertainty as 
one standard deviation from the mean. The up- 
per limits on <JxB at the 95% confidence level 
obtained using Eq. (6), integrating over all pos- 
sible values of AC, are listed in Table IV. We use 
these limits to constrain [9] a model of topcolor- 
assisted technicolor, and exclude at the 95% C.L. 
the existence of a leptophobic Z' boson with mass 
M x < 560 GeV/c 2 , for a width T x = 0.012M X , 
as shown in Fig. 2. 



TABLE IV. The 95% C.L. upper limits on a x B for 
narrow resonances of mass Mx decaying into ti. 



M x 
(GeV/c 2 ) 


95% C.L. upper limits on 
o x B (pb) 


400. 


5.0 


450 


4.5 


500 


2.7 


550 


2.3 


600 


2.3 


650 


2.0 


750 


1.3 


850 


1.5 


1000 


2.0 
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M x (GeV/c 2 ) 

FIG. 2. The 95% C.L. upper limit on axB as a func- 
tion of resonance mass Mx- Included for reference is the 
predicted topcolor-assisted technicolor cross section for a 
width T x = 0.012M X . 

In conclusion, after investigating 130 pb -1 of 



data, we find no statistically significant evidence 
for a ti resonance, and establish upper limits on 
a x B at the 95% C.L. for M x between 400 and 
1000 GeV/c 2 . We also exclude at the 95% C.L. 
the existence of a leptophobic Z' boson with mass 
M x < 560 GeV/c 2 , for a width T x = 0.012M X . 
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